Rules for transition rates in nonequilibrium steady states 
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Just as transition rates in a canonical ensemble must respect the principle of detailed balance, 
constraints exist on transition rates in driven steady states. I derive those constraints, by maximum 
information-entropy inference, and apply them to the steady states of driven diffusion and a sheared 
lattice fluid. The resulting ensemble can potentially explain nonequilibrium phase behaviour and, 
for steady shear, gives rise to stress-mediated long-range interactions. 
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If we wish to design a driven stochastic model that ex- 
hibits a nonequihbrium steady state with a given flux, 
how should we choose its transition rates? I answer the 
question by applying Jaynes' principle of maximum en- 
tropy inference (MaxEnt). It might seem perverse to 
specify a macroscopic result, and then infer an equation 
of motion, since theoretical modelling usually involves 
the reverse procedure. However, for equilibrium systems, 
the principle of detailed balance (DB) is derived in just 
this way. The mean energy is fixed, and the equilibrium 
ensemble defined as the distribution of states respecting 
that constraint, unbiased by any other information. One 
then infers the properties of the appropriate reversible 
dynamics, obtaining a set of rules, DB, which demands 
that the ratio of rates for a transition and its time-reverse 
is given by the Boltzmann factor of the energy costflj. It 
is commonly assumed that the same conditions of DB 
should be used in nonequilibrium models subjected to a 
finite through-put of fiux, so that the dynamics of local 
transitions is governed by the same physics as at equi- 
librium. However, I shall show that those are not the 
transition rates predicted by MaxEnt when a mean flux, 
as well as a mean energy, is specified. The hypothesis 
that the phase-space paths adopted by nonequilibrium 
systems are distributed according to MaxEnt has been 
supported by some notable successes, including the recov- 
ery of linear transport theory^ and, more recently, the 
fiuctuation theorem |3| and self-organised criticalityitll . It 
is also a cornerstone of the GENERIC 5] approach to 
nonequilibrium kinetics. 

We define a particular nonequilibrium ensemble to be 
the set of phase-space paths available to a system, mini- 
mally constrained by fixing only the mean energy and fiux 
on those paths. The unbiased distribution of paths ap- 
propriate to those constraints is given by MaxEnt. Hav- 
ing defined this ensemble, we may investigate its proper- 
ties without controversy. A leap of faith is required only 
to hypothesise that the ensemble is a good description 
of some physical systems under realistic forcing condi- 
tions. If so, then the method will have important im- 
plications for nonequilibrium phase transitions such as 
shear-banding*^ and jamming'^. I derive physically con- 
vincing results for two applications: driven diffusion, and 
a model of interacting particles under shear. 

Jaynes[3 showed that Shannon's information 



entropy|8j] Si = ^ X^r ^^^'(^) maximized by 
the distribution p{V) of states in the equilibrium canon- 
ical ensemble, recovering the Boltzmann distribution. 
But Jaynes also applied the method to nonequilibrium 
problems, for which T represents an entire path through 
phase space, spanning the duration r of the nonequi- 
librium experiment in question. The maximization is 
constrained by whatever information is known about 
the paths. At equilibrium, a constant mean energy E is 
specified. To define a driven steady-state ensemble, we 
shall additionally stipulate a (possibly multi-component) 
mean flux J. We shall write pr{X\Y) as the normal- 
ized probability for any quantity X exhibited by the 
system during the time interval r, subject to conditions 
Y . Thus, MaxEnt yields the conditional probability 
Pt(X\JiE) that, over the duration r, the system takes 
a path r, given that the mean energy and flux have 
the values specified. If ergodicity is assumed then, for 
T ^ oo^ E and J can be interpreted as time-averages. 
So the system's energy and fiux are allowed to fluctuate, 
but their averages over the duration r must have exactly 
the specified values on all the paths considered. 

Our aim is to find the rate, in the driven ensemble. 
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for a system to undergo some transition a ^ b. This is 
the probability (per unit time) that the transition will 
occur within an interval At of the current time {t — 0), 
given that the current state is a, and that the energy and 
flux will eventually (over duration r) have the specified 
time-averages. The constraints E and J, which define 
the nonequilibrium ensemble, apply only to the duration 
T as a whole; we do not constrain the energy and fiux at 
each interval At separately. A conditional probability of 
the kind in Eq. can be manipulated by Bayes' theo- 
rem, which gives two equivalent expressions for the joint 
probability of performing the transition a b within 
time At, and acquiring a mean flux J in time r, given 
the mean energy and initial state, thus: 

PAt{a ^ b\a,J,E)pr{J\a,E) = 

PAt{a b\a, E)pr{J\a b, E). 

Normalization implies that Pt{J\ ■ ■ •) has dimensions of 
reciprocal flux. Substituting into Eq. ^ and recognising 
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that quantities for which only the mean energy is con- 
strained belong to the equilibrium ensemble, yields 
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Equation (0) confirms, as asserted above, that the rate 
of a transition a b in the driven ensemble is not equal 
to the rate at equilibrium, but is enhanced by a factor 
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This factor is known in principle, as it is a property of the 
corresponding system at equilibrium, not in the driven 
ensemble. The denominator in Eq. Q is the probabil- 
ity that a system, starting in the current state a, will 
exhibit an average flux J over the duration r if it is gov- 
erned by the equilibrium transition rates. Of course it is 
exceedingly unlikely for an equilibrium system to spon- 
taneously perform sustained flow, so the denominator is 
infinitesimal. The numerator in Eq. ^ measures the in- 
finitesimal probability of that same flux at equilibrium, 
given that the dynamics begins with a transition to state 
b. We shall see that Eqs. 13 rnake intuitive sense in 
some examples below. 

The above derivation exploits the fact that the driven 
ensemble is a sub-set of the equilibrium ensemble (albeit 
in the extreme tail of the flux distribution), since it is 
defined by one extra constraint. But the 'sub-ensemble 
dynamics' (SED) [Eqs. (0 (SJ] should not be mistaken 
for a near-equilibrium approximation since the sub-set 
of paths has properties very different from the equilib- 
rium set. Nevertheless, an equilibrium Markov process 
remains Markovian under SED. For many transitions, 
that contribute no flux and do not alter the future likeli- 
hood of flux, rjab = 1 so Eq. ^ says the rate is equal in 
the driven and equilibrium ensembles, as often assumed. 
Two types of transition are boosted in the driven ensem- 
ble: (A) a transition that carries a positive flux in the 
direction of J, (B) a transition to a state that is more 
amenable to subsequent flux-carrying transitions. 

Many choices of prior rates oj'^^i, are possible, either 
fully implementing Newton's laws, or embodying approx- 
imate (e.g. Brownian) dynamics. Consider the exact 
Newtonian evolution of the particles of a fluid element 
surrounded by a reservoir of more fluid. Unphysical tran- 
sitions, e.g. violating momentum conservation for inter- 
nal degrees of freedom, have zero prior rate, so Eq. Q 
also forbids such transitions in the driven case, e.g. under 
shear flow. Thus, the scheme respects Newton's laws and 
is consistent with the Liouville equation. The reservoir 
introduces randomness into the dynamics by coupling to 
particles at the surface of the fluid element. SED provides 
the unbiased description of the reservoir's influence. 

We now study two examples with Brownian prior dy- 
namics. The first, a driven Brownian ideal gas, is simple 
enough for exact calculation, but exhibits only 'type A' 
transitions. More of the physical richness of SED will 
appear in the second example, a complex system under 
shear that demonstrates both types of enhancement. 



Let us find the equation of motion for the particles 
of a Brownian ideal gas with a drift velocity v. The 
problem de-couples for each component of each parti- 
cle's displacement. The non-trivial part is the component 
in the flux direction. We must assume prior knowledge 
of the motion at equilibrium, for which each coordinate 
x{t) performs an unbiased random walk according to the 
Langevin equation, (^dx/dt — ^(t) with ^ a friction con- 
stant, and ^ a delta-correlated noise function^. We in- 
troduce a time step At (that will eventually be taken to 
zero), so that the thermal noise ^ is drawn from a well- 
behaved Gaussian distribution '9j and the Langevin equa- 
tion relates this stochastic variable ^ to a step x — *■ x+Ax 
such that Aa; = £^At/C- This equilibrium dynamics dic- 
tates that each Brownian particle follows a path with 
steps drawn from the distribution 
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which corresponds (per unit time) to a transition rate 
(per unit distance) in the notation of Eq. ||2Jl. 

Here, G{x, t) is the Green function for free diffusion, and 
the diffusion coefficient is given by the Einstein relation 
D = kBT/(. Now, from the set of all equilibrium paths, 
we extract the sub-set exhibiting the required flux v, by 
introducing a posteriori the constraint x{t) — vt = xq 
[To|. On those paths, the rate of a step Aa; from position 
X at time t is enhanced by 

G(xo — X — Ax, T — t — At) 

11x,x+Ax = -pT/ T{ (5) 

G(xo — x,T — tj 

[from Eq. Q], since the probability of an equilibrium par- 
ticle achieving the required displacement in the remain- 
ing time is given by the Green function for free diffusion. 
Substituting Eq. ((SJ into Eq. 10) in the limits t ^ t and 
\xo \ > |a;| yields 
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where the second line follows by inspection of Eq. 
Drawing Ax from in Eq. Q yields the equilib- 
rium dynamics. So Eq. © specifies that substituting 
Aa; — V At for Aa; in the equilibrium equation of motion 
will yield the dynamics of the driven Brownian ideal gas. 
Making that substitution, with At ^ 0, gives 



(7) 



where ^ is the usual Gaussian white noise. This is the 
equation of motion for driven diffusion that one could 
easily have written down. But it was not conjectured; it 
was generated from the Langevin equation for free dif- 
fusion, by the sub-ensemble method. In fact, one could 
write any number of stochastic equations that yield the 
net drift vt over the fixed duration r, e.g. with some 



temporal correlations or an additional oscillatory forc- 
ing term that integrates to zero. But Eq. Q specifies a 
unique solution. Any equation of motion other than the 
simple one specified by these dynamics would violate the 
MaxEnt hypothesis, indicating that it introduces unwar- 
ranted new information about the paths, additional to 
the prior dynamics and posterior constraint. 

Let us consider a second example, demonstrating that 
rates respecting DB are not generally correct for driven 
systems. In a simple 2D model of Brownian particles 
under continuous shear, a triangular lattice has some 
fraction of its sites occupied by monomers with nearest- 
neighbour interactions. An average velocity difference 
between the top and bottom boundaries is established by 
stochastically selecting a horizontal layer I between two 
rows of the lattice, and shifting all of the system above 
this layer to the right by one lattice spacing. If the layers 
are selected with equal probability, these discrete shear 
transitions will result in a uniform shear rate when ob- 
served on large length- and time-scales. In addition to 
the shear steps, local dynamics consists of choosing a pair 
s of neighbouring sites at random and swapping them, 
with a rate Us- If one site is occupied by a monomer 
and the other empty, the transition causes the monomer 
to hop, and might result in an energy change by making 
or breaking bonds. Repeating the same swap s recovers 
the original configuration. In the absence of shear, tran- 
sition rates respecting DB, e.g. 'heat-bath dynamics' 0, 
will correctly generate all static correlations. With shear 
applied to our model, let us initially violate Eq. and 
assume that the same equilibrium dynamics is chosen for 
the local swap transitions. 

The model as defined would settle into a driven steady 
state in the long-time limit and, by tuning the inter- 
actions, could be made to exhibit nonequilibrium phase 
transitions and amusing mesophase structures. But it is 
unphysical, as becomes apparent with a particular choice 
of interactions. Let the monomers be coupled in pairs 
by bonds of infinite strength, to form dimers. A shear 
transition rotates some dimers (Fig.^. Any dimer in a 
north-east south-west orientation prevents shear on the 
layer that it straddles, e.g. in Fig. ^ further shear on 
the same layer is disallowed by a dimer that would be 
broken by the transition. In the thermodynamic limit, 
the chance of finding a lattice layer that is not blocked 
by at least one such adversely oriented dimer vanishes. 
The model cannot be driven to shear. 

It is unreasonable for a dimer to wander through 
configurations under equilibrium-like dynamics, unaware 
that it is blocking a macroscopic flux. Clearly such dy- 
namics will not work for rigid Brownian dimers. Instead, 
DB should be violated, even at the local level, so that 
adversely oriented dimers are pushed out of the way of 
the applied flux. Even a dimer of finite strength should 
prefer re-orientation to shear-induced dissociation. The 
rate of re-orientation is prescribed by SED. 

Consider first how SED treats shear steps. A shear 
step is a 'type A' transition as it contributes a quantum 
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FIG. 1: (a) Before, (b) after a sliear step on layer displac- 
ing everytliing above it to tfie riglit, tlius rotating a dimer 
clockwise, and making new contacts between monomers. 



of shear flux. In an equilibrium model with both forward 
and reverse shear steps, the probability of accumulating 
a large net shear by time t — t is tiny. If a forward 
shear transition a ^ b takes place before t = At, then 
one step fewer is subsequently required to attain the de- 
sired shear, so the numerator of Eq. Q is larger than the 
denominator. Thus Eq. (j^J correctly prescribes a higher 
rate for forward shear steps in the driven ensemble than 
at equilibrium. Similarly, reverse steps are suppressed. 
As shear steps on different layers I (see Fig. ^ contribute 
equal flux, they have approximately equal enhancement 
factors. But their rates ix'f"^ are not necessarily equal 
(yielding affine shear) since, by DB, uj'^'^ in Eq. |2Jl de- 
pends on the energy cost. Hence the driven shear steps 
are concentrated on the softest layers, e.g. where fewest 
attractive neighbours will be separated. Rather than im- 
posing affine shear, the driven ensemble, with its weak 
constraint fixing only the total mean flux, allows authen- 
tic inhomogencous flow. 

As well as prescribing the rate of shear steps, Eq. Q 
also governs the local site-swapping dynamics. The site- 
swapping transition s indicated in Fig. |21 is not of 'type 
A', as it contributes no shear flux, but we shall see that 
its rate is boosted by SED as it is a 'type B' transition. 
In Fig. [3 forward shear is blocked on every lattice layer 
by adversely-oriented dimers. So there is no chance of 
immediate shear and, of course, little hope of the desired 
net flux over the duration r of an equilibrium experi- 
ment. Hence the denominator of Eq. |(2Jl is very small. 
The numerator asks for the likelihood of that same shear 
flux if swap s (represented by a —* b) is first performed. 
This would rotate an offending dimer, allowing forward 
shear on the layer shown in bold. A shear step is not 
guaranteed to follow swap s, but its likelihood is greatly 
increased by the swap. Further shear could follow, until 
eventually some dimers re-block the layer, returning to a 
configuration statistically similar to Fig. [21 Hence, if s 
is performed, the probability of achieving the desired net 
flux at equilibrium, although small, is many times larger 
than the denominator of Eq. Q . So SED greatly boosts 
the rate for swap s in Fig.|21 and the highlighted dimer is 
quickly 'pushed out of the way'. Similarly, if transition s 
were blocked by another dimer it too would be moved by 
SED, and so on, with correlated chains of events enabling 
the stipulated mean flux to be realised. 

It is startling that SED has generated long-range cou- 
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FIG. 2: A configuration that cannot admit a forward shear 
step. After swap s, the highlighted layer can shear. 

plings governing the local swaps, whereas their prior equi- 
librium dynamics depends only on nearest-neighbour in- 
teractions. Because the dimer highlighted in Fig. [3 is 
alone in blocking its layer of the lattice, it is quickly 
rotated under applied shear. It feels that there are no 
other soft planes in the whole lattice that could yield. If 
there were, the dimer would not feel such an imperative 
to move, as the enhancement factor would be smaller. 
We interpret that stress is concentrated at this point. 
The physics of long-range stress-mediated interactions 
has arisen naturally. 

Unlike the example of the Brownian gas, the Green 
function for the dimers is unknown, so an exact calcula- 
tion is not presented. The problem is that evaluation of 
Eq. lO appears to require clairvoyance of the full conse- 
quences of a proposed transition. However, those conse- 
quences need only be forecast for a finite time into the 
future, exceeding any correlation time, following which 
the steady state can be assumed. The problem is gen- 
erally tractable in terms of a cluster expansion pT|. We 
can speculate that the limit in which such an expansion 
breaks down (because many correlated particle move- 
ments are required for any finite flux probability) might 
be identified with a jamming transition Jj, just as break- 
down of the virial expansion accompanies a critical point. 

The method outlined here (detailed elsewhere flT'l) puts 
the simulation of driven steady states on a closer footing 
to equilibrium numerics, for which any DB-respecting al- 



gorithm yields the Gibbs ensemble. By contrast, sheared 
fluids have hitherto required microscopically accurate 
simulations [l^. with the associated processing overhead 
and thermostatting issues^^. This scheme is not the 
only route to nonequilibrium transition rates. Models 
may be defined that violate Eq. ||2Jl , but one should then 
be aware that extraneous information has been intro- 
duced, not present in the prior dynamics and macroscopic 
observables. In this respect the rules set out here have 
the same status as the principle of DB. 

The driven ensemble has been defined here by fixing 
the time-averaged flux on each path, analogous to fix- 
ing energy in an equilibrium microcanonical ensemble. 
In the limit r — > oo (analogous to the thermodynamic 
limit), identical results follow from an alternative ensem- 
ble, in which paths are weighted exponentially by their 
flux, analogous to the canonical ensemble. Details will 
appear in a longer paper but note that simply boost- 
ing a transition exponentially by the immediate flux that 
it carries would neglect the subtle non-mean-field time 
correlations of SED. 

I have studied the physical implications of MaxEnt for 
driven steady states and shown how to implement the 
resulting dynamics. The approach is unique in deriving 
dynamical rules for a driven system under the stochas- 
tic influence of a reservoir, without requiring any ap- 
proximate coarse-graining or near-equilibrium assump- 
tion. The rules have yielded a rich variety of correct 
physics for driven diffusion and Brownian dimers under 
shear. Many quiescent systems are well approximated by 
the laws of canonical equilibrium, but exceptions include 
glasses, granular media, and some cellular automata. 
Similarly, not every nonequilibrium steady state will re- 
spect the conditions presented here, but those that do 
are expected to form a large and significant class. 
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